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ABSTRACT 

Let  x(t)  be  a  diffusion  satisfying  the  stochastic  differential 

equation  dx(t)  =  f(x(t))dt  +  db(t),  where  f ' (x)  +  f2(x)  *  ax2  +  bx  +  c, 

a  >  0.  V.  Benes  gave  an  explicit  formula  for  the  conditional  density  of 

x(t)  given  y(s),  0  <  s  <  t,  where  y(s)  *  /Scfslds  +  w(t),  when  w(*)  is 

0 

a  Brownian  process  independent  of  x(*).  This  result  is  extended  and  then 
applied  to  derive  recursive  filtering  equations  for  estimating  conditional 
moments  e{x” (t) |y(s) ,  0  <  s  <  t) ,  for  estimating  polynomial  functionals  of 
x(»),  and  for  smoothing. 
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SIGNIFICANCE  AND  EXPLANATION 


A  common  problem  in  the  analysis  of  stochastic  systems  is  the  estimation 
of  the  system's  state  given  only  noise- corrupted  or  incomplete  observations. 
For  instance/  examples  occur  in  communications  theory  when  one  wants  to 
estimate  a  signal  sent  over  a  noisy  channel.  The  problem  of  filtering  is  to 
build  an  estimate/  i.e.  filter,  that  provides  the  best  information  about  the 
state  given  the  observations. 

The  most  desirable  solution  to  a  filtering  problem  is  a  recursive/ 
physically  realizable  algorithm  that  computes  the  best  mean- square  error 
estimate,  and  thus  it  is  important  to  find  models  for  which  such  algorithms 
exist.  Recently,  BeneS  defined  a  class  of  filtering  problems  that  allow 
explicit  computation  of  the  conditional  density  of  the  signal  given  the  past 
of  the  observations.  This  paper  extends  his  result  and  then  uses  it  to  build 
exact,  recursive  algorithms  for  estimating  any  moment  of  the  signal  and  for 
estimating  polynomial-type  transformations  of  the  signal . 


I 
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The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 
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1 .  Introduction . 

Let  f(x)  be  a  real-valued  function  defined  on  all  of  It  and  satisfying 
the  Riccati  equation 

f*  (x)  +  f2(x)  *  ax2  +  bx  +  c.  (1.1) 

It  is  assumed  that  f  has  no  singularities.  Note  that  this  implies  a  >  0, 
for  otherwise  f  explodes  at  some  finite  x.  This  paper  considers  the 
filtering  problem 

dx(t)  =  f(x(t))dt  +  db(t) 

(1.2) 

x(0)  *  x  e  r 

dy(t)  =  x(t) dt  +  dw(t)  (1.3) 

in  which  b(*)  and  w(*)  are  independent  Wiener  processes,  x(")  is  the 

signal,  and  y(*)  the  observation  of  x(»). 

For  the  system  ( 1 .1  .)-( 1 .3) ,  BeneS  [1]  recently  derived  an  explicit 

y  y 

formula  for  the  conditional  density  of  x(t)  given  F*  ,  where  F'  :>*  o- 
algebra  generated  by  (y(s) |0  <  s  <  t) .  This  result  is  interesting  because 
the  class  of  functions  satisfying  (1.1)  includes  nonlinear  f,  whereas 
conditional  densities  for  (1  .2)  —  (1 .3)  had  been  computed  previously  only  for 


^Mathematics  Department  and  the  Mathematics  Research  Center,  University  of 
Wis cons in-Madison,  Madison,  WI  53706. 

2 

Electrical  Engineering  Department,  University  of  Maryland,  College  Park,  MD 
20742. 

3Department  of  Electrical  Engineering,  University  of  Texas  at  Austin,  Austin, 
TX  78712. 


Sponsored  by  the  United  States  Array  under  Contract  No,  DAAG29-80-C-0041  .  The 
work  of  the  first  author  was  supported  by  the  National  Science  Foundation 
under  Grant  No.  MCS-7927062.  The  work  of  the  second  author  was  supported  in 
part  by  the  Office  of  Naval  Research  under  Contract  N00014-79-C-0808.  The 
third  author  was  supported  in  part  by  the  Joint  Services  Electronics  Program 
under  Contract  F4  9620-77-C-0101 . 


J 


linear  f:  for  examples  and  an  extension  to  the  multidimensional  case,  see 
BeneS  [ 1 ] . 

Besides  conditional  densities  one  also  wants  to  calculate  filters 

e{<p|F^}  of  x(  • )-  dependent  statistics  ^  .  Given  a  random  process  <p[t) 

we  shall  say  that  E(v>(t)|F^}  is  finite  dimensionally  computable  (FDC)  if  it 

can  be  expressed  as  the  output  of  a  finite  dimensional  system  of  stochastic 

differential  equations  driven  by  y(*).  When  the  signal  dynamics  in  (1.2)  are 

linear,  many  examples  of  FDC  estimates  are  known.  For  example,  E(xn(t)|F^J 

is  FDC  for  any  integer  n,  since  the  Kalman-Bucy  equations  calculate 

E{x(t)|F^}  and  the  conditional  variance,  and  higher  order  moments  are 

derived  from  these  by  virtue  of  the  normality  of  the  conditional  density.  A 

more  subtle  class  of  examples  consists  of  estimates  E(n(t)|F^}  where  n(t) 

is  any  polynomial  functional  of  x(*)  in  the  form 
s  k  k 

n(t)  *  }***  /  n  Y(s,,***,s  )x  (s,),Mx  n(s  )ds  •••ds,  1  <  i  <  n, 

.  .  l  n  i  n  n 

0  0 

in  which  Y  is  a  separable  function  and  the  (k^J  are  non-negative  integers 
(Marcus,  Willsky  [7] ;  Marcus,  Mitter,  Ocone  [6]).  Formulae  and  recursive 
systems  for  the  smoothed  estimate  e{x(s)|F^}  are  also  well  known  (see  13]). 

In  this  note,  we  extend  the  linear  theory  by  showing  that  these  same 
statistics  are  FDC  for  the  general  model  (1.1)- (1.3).  The  strategy,  as  in  the 
linear  case,  is  to  derive  finite  dimensional  systems  by  using  the  explicit 
form  of  the  conditional  density  to  truncate  formally  infinite  dimensional 
systems  of  moment  equations.  The  material  is  organized  as  follows.  In  §2  we 

y 

calculate  conditional  joint  densities  of  x(»)  given  F*.  As  a  consequence, 
we  show  that  the  conditional  law  of  the  process  (x(s)|0  <  s  <  t)  given  F^ 
and  x(t)  is  Gaussian.  This  is  precisely  the  feature  that  makes  it  possible 
to  handle  polynomial  functionals.  In  §3,  we  prove  FDC  of  conditional  moments, 
smoothers,  and  polynomial  functionals. 


Lie  algebraic  techniques  from  geometric  control  theory  have  been 
introduced  recently  into  filtering#  especially  as  regards  finite  dimensional 
computability,  and  they  have  been  worked  out  successfully  for  known  FDC 
problems  in  which  f  is  linear.  (For  a  survey  of  these  ideas,  see  Brockett 
[8].)  The  main  results  of  this  paper,  in  particular  proposition  3.7,  were 
suggested  by  a  Lie  algebraic  analysis  of  (1.1)— <1.3).  Consequently,  it  seems 
that  the  full  range  of  the  Lie  theory  for  linear  drifts  extends  to  the  general 
case  (1.1).  Since  our  methods  here  are  not  algebraic,  we  do  not  pursue  the 
issue  further,  but  refer  instead  to  Ocone  [7]  for  further  discussion. 


2.  Conditional  Joint  Penalties. 

Let  x(#)  and  y(*)  be  given  from  (1.1)-(1.3),  and  let  t  ■  sQ  >  s^  > 

T 

•••  >  sn  >  0,  z  -  (zQ/z1, ••*,zn)  .  The  expression  p(zQ ,t»z1 ,8^ > • • •> 

z  ,s  |Fy)  shall  denote  the  joint  density  of  (x(t),x(s, ),••*, x(s)) 
n  n  t  in 

conditioned  on  Fy,  that  is,  for  any  bounded,  Borel  »  Rn+  ♦  R 


E(iJ»(x(t),***,x{sn))|F^} 


f 


In  Theorem  2.1  of  this  section,  we  employ  a  method  of  Bene?  [1]  to  compute  an 

explicit  formula  for  this  conditional  density.  From  this  we  then  derive 

p(z.,s.»  •••jz  , s  |Fy,x(t))  the  conditional  density  of  (x(s. ),•••,  x(s  )) 

1  1  n  n  t  in 

given  F  *  and  x  ( t ) . 

The  results  are  stated  in  terms  of  an  auxiliary  process  5(t),  evolving 
in  R  and  defined  by 


dC(t)  *■  A(t)C(t)dt  + 


1 

y(t) 

L  0  J 


dB(  t ) 


where 


5(0)  -  (x,0,0) 


A(t) 


-<0  0 

0  0  0 

<y(t)-V2b  0  0 

V- 

<  -  (a+1 )  '2 


and  B( •)  is  a  Brownian  motion  independent  of  the  signal  and  observation 


noises,  b( * )  and  w(*) 


I 


50  -  (£T(t) ,5T(«1) »**• »5T(8n) )T 


S*  (S^t)  ,51(s1),,*,,C1(sn)) 

Then  the  following  conditional  moments  are  needed: 

m{t)  :■  E(£(t) |F^} 
R(t,s)  :*  oov(5(t)  ,S(s) 

R(t)  =*  ^rij  i<if  j<3  s* 


H(t,sl('"(8  )  »-  E(H|Fp 
in  t 


«  (m.(t) ,  •  ,m  (s  )) 

i  in 

p0(t'V**'V  s“  Var(s0|F^ 

P(t,s1 ,***,sn)  :*  Cov(S,S0|F^) 

-  E((a  -  M)  (aQ  -  e{H0|F^})T|F^} 

Q(t,st  ,*«*,sn)  :=>  Var (H|F^)  . 

To  simplify  later  expressions,  we  shall  often  drop  the  (t/S^ , • • • ,sn  ) 
dependence  and  write  only  M,  Pq,  P  and  Q.  In  addition,  let 
v  -  (0,1 ,-1 ,0, • ••  ,0)T  e  p3(n+1)^  The  random  vectors  PQv  and  Pv  play  an 
important  role  in  theorem  2.1  and  are  related  by 

PV  -  ((P0v)r(P0v)4,*««,(P0v)3n+1)T. 


Note  that  (Pv)k  -  (P0v)3k_2 


cov(51(sk_1) ,C2(t)  ~?3(t)|F^). 


It  is  important  to  observe  that  all  these  conditional  moments  are  properly 
thought  of  as  functionals  (on  C[0,t] )  of  y(»).  Indeed,  these  functionals 


are  easily  calculated  by  solving  for  every  y(*)  e  Ct0,t]  the  system 


-5- 


In  expression  (2.2),  we  think  of  y(t)  as  a  fixed  function  and  of  E  as  an 
expectation  against  the  measure  V  induced  by  (1.2)  on  the  space  of 
continuous  sample  paths  x(*).  here  means  proportional  up  to  a 

normalization  factor  that  does  not  depend  on  z.  To  evaluate  (2.2)  we  follow 
Benes  and  apply  a  sequence  of  Girsanov  measure  transformations.  Let  u 

B ,  x 

denote  the  measure  on  C[0,t]  induced  by  x  +  B(*).  Then  u  <<  u  and 

B,x 


-6- 


dU 


(x(*))  -  exp{  j^ffxtsJldxfs)  -  Vo  f1*2  (x(s))  ds ). 


B,X 


By  using  this  to  change  measures  in  the  expectation  teem  of  (2.2)  and  noting, 

by  Ito's  rule,  that 

/*  x(s)dy(s)  -  x(t)y(t)  -  fty(a)dx(s) 

0  0 

and 


F(x+B(t) )  -  F(x)  -  /fc  f (x+B(s) )dB(s)  -  V2  f*  f * (x+B(s) )ds, 

0  0 

we  derive 

p(***)dz  *  exp{F(zQ)  -  F(x)  +  zQyt) 


*  E(  n  1{X+B(S  )£liz  }exp  ~P~ y(s)dB(s)  -  V2  jMx+Bts)  )ds) 


(2.6) 


where  V(x)  *•  (a+1)x  +  bx  +  c.  To  evaluate  this  last  expectation,  we  treat 

the  quadratic  part  of  V  as  arising  from  the  Radon-Nikodym  derivative  of 
x  +  B(  • )  with  respect  to  the  Ornstein-Uhlenbeck  process  5^(»)l  the  linear 
terms  in  the  exponent  in  (2.6)  can  then  be  re-expressed  in  terms  of  £  (•) 
and  5j(*)«  The  result  is 


(Zq-X)' 

exp{xk(z  -x)  +  k [ - - — 


-  t]} 


x  e{  n 

1H> 


(C1 (3^ )edz^ 


jexp-(52(t)-C3(t) ) 


i^l 


(2.7) 


Given  F^,  £(•)  is  a  Gaussian  process 

be  written,  up  to  a  normalizing  factor, 

;  ai  .*p<-  v2  <5  -  a  *  p0v,  pj1 

p2"*2 


,  and  thus  the  expectation  in  (2.7)  may 
as 

((  *  E  s  +  P  v)>>exp  V?  <v,P  v> 
y  0  0  *  0 
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where  E  5 

y  0 


=  e{2q|F^}  and  where  dC  signifies  that  m  zQ, 

Z  *  z.,  ••*,£_  *  z  are  held  fixed  and  integration  is  over  the  remaining 

4  1  3n+ 1  n 

variables.  But  this  last  expression  integrates  by  standard  Gaussian  integral 
formulae  to  a  factor  proportional  to 

exp{-  V2  <z  -  M  +  Pv,  q""1  (z  -  M  +  P)>).  (2.8) 

By  combining  (2.6)— (2.8),  we  arrive  at  the  desired  result.  ■ 

The  conditional  density  of  the  process  x( •)  thus  consists  of  a  Gaussian 
factor  multiplied  by  expF(zg).  Further  conditioning  on  x(t)  will  remove 
exp  F(z0)  and  leave  only  the  normal  part.  Indeed,  let 


Pv 


=( 2)  lF  .  . 
*  ■  'W 

T 

- 

ri1(t> 

C12 

C21 

q22 

«  Var(H(2^ |F^) 

r 

1 

’ri2(t,-C13(t>" 

m1  (t) 

,  M  =* 

Pvl2» 

m(2) 

_ 

Corollary  2.9.  The  conditional  law  of  (x(9.),,,,,x(s  ))  given  Fy  and 

111  t 

x(t)  is  normal  with  mean 


(2)  (2)  -1 

W  '  -  PVV  '  +  r^(t)  Q21  (x(t)  -  m1  (t)  +  Pv1 ) 


and  variance 


Q22"ri1(t)Q21Q12. 


I 


i 


Proof.  Use  (2.1)  to  conclude  that 


P<Va1,***,V8nl  X0(t)~  VFt}  "  P<zo't,*”,zn'Sn|Ft)/p(zO't|Ft) 


*  exp  (-  V2  <5.  “  M  +  Pv ,  Q  ( z_-  M  +  Pv )  > } 

x  exp {  Vo — -  —  (z  -  m  (t)  +  (Pv)  )2}). 

'r^tt)  0  1  1 

But  this  is  just  the  conditional  density  of  n^,***,n  9^ven  where 

( , *  *  * , n  )  is  a  normal  random  vector  with  mean  M  -  Pv  and  variance  Q. 

The  result  then  follows  from  the  standard  formula  for  conditioning  one  part  of 

a  normal  random  vector  upon  another.  8 

This  corollary  demonstrates  how  closely  those  diffusions  defined  by 

(1.1)- (1.2)  are  related  to  Gaussian  processes.  In  fact,  the  steps  above  can 

be  repeated  to  calculate  joint  densities  of  the  process  x{*)?  (2.1)  yields 

the  correct  expression  if  y(*)  is  replaced  by  0  .  Then,  in  the  same  way, 

it  follows  that  (x( s . ) ,  •  * *,x( s  )|x(t))  is  normal,  that  is,  the  process 

1  n 

(x(s)|0  <  s  <  t)  conditioned  on  the  endpoint  x(t)  is  Gaussian.  This 
conditional  normality  is  key  to  the  filtering  results  of  §3. 


r  •»*■*«•*-* 


3.  Filtering  equations 


3.1.  Conditional  Momenta. 

A  A 

Let  x  (t)  t“  E{x( t) |F^ }.  x"(t)  satisfies  the  equation 


.  .  4W«//n-2  .  ..  .  n-1,_  .  . 'O’l  ..  *  , 

dx  *  tn(n-1)/2x  +  nf(x)x  ] dt  +  [x  -  xx  ] tdy  -  xdt] 


(3.1) 


(Fujisaki,  Kallianpur,  Kunita  [2]).  To  calculate  x  one  must  therefore  also 
find  xn+1,  f(x)xn,  etc.  These  in  turn  also  satisfy  stochastic  differential 
equations  that  introduce  yet  other  quantities  to  be  estimated.  Continuing  in 

A 

this  manner,  if  we  begin  with  x,  we  arrive  at  an  infinite,  coupled  set  of 
conditional  moment  equations  for  x,x  ,  •  •  *,x  ,  ***,f(x)x,  etc.  Our  approach 
to  finite  dimensional  computability  will  be  to  use  conditional  moment 
identities,  derived  from  the  form  of  P(x,t|F^f),  to  truncate  this  infinite 
system  after  a  finite  number  of  terms.  Actually,  FDC  of  the  moments  could  be 
argued  on  general  grounds  using  the  fact  that  the  FDC  process  p(t)  (see 
immediately  below)  characterizes  p( z,t|F^) .  However,  the  approach  here  leads 
to  explicit  filtering  equations. 

Straightforward  analysis  of  (2.1)  shows  that 


p(x,t|F^)  -  exp{F(  z)  “  U-y(t)  )2/2a(t)  } 


where  N(t,x)  is  a  normalizing  factor,  and 

a  *  1  -  <  a  a(  0 )  ■  0 

dp  *  1-k2  au  -V^bcldt  +  ody  p(0)  *  x 
(See  BeneS  1 1  ] . )  Note  that  (3.2)  implies  that  1  -  <2o2(t)  >  0 
and  hence  that 

a  <  a”1 (t)  V  t  >  0. 


(3.2) 

(3.3) 


-10- 


*1-  -  - 


As  a  consequence,  xn(t)  is  well-defined  for  any  n  .  If  a  >  0,  (1*1) 


1/,  a  '2  2 
implies  f(x)  ~  a  *x  as  |x|  +  *  and  thus  that  P(s)  -  — j-  z  as 

|z|  +  <».  Therefore 

F(z)  -  (z  -  p)2/2o  ■“ V>  (a  ^  -  o  Sz2,  |  z  1  +  «• 


and  so  P(z,t|F^)  decays  as  exp[-6z2],  6  ■  V2  ( 0  1  -  a  ^  )  >  0.  If  a  *  0, 
then  b  -  0,  c  >  0  is  necessary  in  order  that  (1*1)  have  a  solution  f  on 
R  without  singularities.  Then  f  will  be  bounded, and  F(  z)  will  grow  at 
most  linearly. 

Lemma  3.4.  For  n  >  0 

,  -1  /^n+2  , „  -2,^n+1  t  i4 .  2.  -1.^ 

(a  -  a)x  -  (b  +  2po  )x  +  (c  +  ((2n+1)  -  u  )o  )x 

_  -1 ^n-1  ,  4/n^2 

+  2  vno  x  -  n(n-1)x  . 


Proof.  Integrating  by  parts,  we  have 


2 

r7T  rr  C**  expF(z)  — ~(zn  exp[-(z  -  p)  /2a]) 


/”dz[f'(z)  +  f2(z)]znp(z,t|F£) 


^nf2  .  ^n+^  Oi 
ax  +  bx  +  cx  . 


.2 

d  r  n 


Evaluation  of  (z11  exp[-(z  -  u)/2a]}  in  the  first  integral  leads  to  the 


desired  identity. 


Proposition  3. St  x  (t)  Is  FDC  for  all  n  . 


-1  'm 

Proof :  Since  a  (t)  -  a  >  0  ,  lemma  3.1  Implies  that  x  (t),  m  >  2  can  be 

expressed  as  a  linear  combination  with  FDC  coefficients  of  lower  order 

A 

conditional  moments.  Thus  it  suffices  to  prove  that  x(t)  is  FDC.  For 

A 

x(t),  (3.1)  becomes 

dx  “  fTx)dt  +  (x^  -  x2)(dy  -  xdt),  x(0)  *  x  . 


f(x)  -  -r  /  dz[d/dz  expF(  z)]  exp[-(  z  -  u)2/2a] 


-  /  dz( z  -  u)  a  p(z,t|F^) 


-(X  -  p)<J 


x^  =  [x(b+2po2)  +  c+  (1  -  y2)©1]  (a1  -  a) 


dx  =  (  p  -  x)  o  dt 

+  t(x(b  +  2yc  2)  +c  +  (1  -  /ifl  ')(o  '  -  a)  1  -  x2]  [dy  -  xdt) 

A 

together  with  (3.2)— (3.3)  constitutes  a  finite-dimensional  system  for  x(t) 


Remark.  It  is  also  clear  that  f(x(t))x  (t)  will  be  FDC  for  any  m  simply 
eliminate  f(x(t))  in  favor  of  polynomials  in  x(t)  by  integration  by  parts 
as  in  the  proof  above.  In  the  same  way,  filters  may  be  constructed  for 
any  conditional  estimate  in  the  infinite  set  of  moment  equations  generated  by 

A 

starting  with  x(t)  and  using  (3.1). 
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A- 
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B  5 


3.2.  Smoothing. 

Proposition  3.6.  Let  s  <  t.  Then 


e(x(s)|F^}  =*  Ix(t)  -  xe  Kt  +  (P(t,s)v)lJ  +  xe  Ks  -(P(t,s)v)2< 


Proof :  This  is  immediately  consequent  from  corollary  2.9  once  it  is  noted 
that 

r111(t)C21  =  r^tJcaWC^t), ?,<•>>  *  flS 

and 

m^(t)  =  xe  . 

Explicit  formulae  for  (P(t,s)v)1  and  (P(t,s)v)2  are  easily  found  and  will 
be  given  in  the  next  section. 

3.3.  Polynomial  Functionals. 

Let  H(t)  be  any  non-anticipating  functional  of  the  signal  process  of 
the  form 

s  .  k  V 

h(t)  ■  /*•••  /  n  Y<s,,***,s  )x  (s. )  •  “x  n(s  )ds  •••ds. 

0  0  Ini  n  n  1 


where  k.,***(k  are  arbitrary,  non-negative  integers  and  Y(s4,,#*,s  )  is  a 
in  in 

A 

separable  function.  Also  let  h(t)  ■  E(h(t)|F^}. 


Proposition  3.7.  h(t)  is  FDC 

For  simplicity  we  restrict  attention  to  the  case 

k-*k_*,#,»k  *1;  the  method  of  proof  extends  easily  to  general 

12  n 

choices  for  the  k^'s.  Our  proof  relies  on  the  following  identity,  presented 
here  in  the  form  that  it  appears  in  Marcus  and  Willsky  (7]. 
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Lemma  3.8.  Let  (u.,***,u  )  be  a  normal  random  vector  with  e4  ■  Bua  and 
~ ~ i  m  3  3 


Vi jr “  cov(ui#Uj3»  Then 


m 

i  ***u  ]  *  JI  e  +  [  V  e  •  •  »e  +Iv  V  e  •  •  »e  +••• 

1  ■  1  *  *  V2*3  V2  VA  \ 


The  sums  are  taken  over  all  possible  combinations  of  pairs  of  indices. 


Lemma  3.9.  Let  s.  >  •••  >  s  .  Then 
-  1  n 


n  , 

e(x(s  )***x(s  )|F)ffx(t)}  -  l  x3 (t)a  (t,s. ,  •  •  »,s  ) 

1  n  j-0  jin 

for  some  separable  functions  a  (t,s.,**»#s  ),  0  <  j-  <  n  ,  depending  on 

j  *  n 


(2)  (2)  -1 

Proof.  wt  ■  "j"  P',l*  rt1(tl  ♦  <Pv),l 


°*  °22  *  'll"1  «12°21 
and  apply  lemma  3.8  and  corollary  2.9.  Thus 


e(x(s  )**‘x(s  )|x(t),F^}  -  l  •••l  +  l  Q  l  •••l 
"  tin  33  i'n 


+  n  Qj  j  i  +  •••  • 

3132  3  J34  3  5  3n 


This  is  an  n1  order  polynomial  in  x(t)  since  is  a  linear  function 

of  x(t)  for  each  j  .  Moreover,  it  is  clear  that  the  coefficients  a^  will 
be  separable  if  P(){t,s1 , • • *,sn)  and  hence  Q(t ,s1 ,  •  •  »,sn)  are  separable  (Q 
is  a  submatrix  of  PQ).  But 


is  the 


R(t,t) 

R(t,s.|)  ••• 

R(t,s  ) 
n 

R(s1#t) 

R(s^,Si )  ••• 

• 

R(s  ,t) 
n 

•  •  • 

R(s  ,8  ) 
n  n 

and  R(t,s)  »  t, s)R( s, a)  ■  $A( t,0 ) ( 8,0 )R( s)  where  *A(t,s) 

state  transition  matrix  of  A(t).  Thus  P.(t, ••*,s  )  is  indeed  separable* 

0  n 

Remark.  Upon  further  inspection  of  the  terms  ^(t,s)  and  R( s) ,  the  proof 
of  this  lemma  demonstrates  that  aj  may  be  written 


(3.10) 


where  each  R  ,  0  <  k  <  n  is  either  deterministic  or  a  non- anticipating 

j  #k 

functional  of  the  observation  process  y(  •). 

Proof  of  proposition:  By  using  lemma  3.9 

EMt)  IFj) 


•••/””  y^s^  •••Yn(sn)E(p[x(s1)  •••x(sn>  |F^,x(t)J  |F^}dsn»»»ds1 
0  0 

n  «  .  A  a 

m  y  xJ(t)  y  \  y(s,,  •••,s  )a  (t,s  , •••,s  )ds  •••ds,  . 

j»0  0  0  1  n  J  1  n  n  1 


To  complete  the  proof,  it  is  only  necessary  to  show  that  the  coefficients  of 
*  i 

x  (t)  are  FDC.  Each  coefficient  is  a  sum  of  terms  of  the  form 

Vllt)  “  °D(t)  f--  /n<*l(ai),-an(»n)d8n*-d91 
which  can  be  computed  on-line  by  the  system 
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u.(t)  -  O (t) 
i  n 


u1  (0)  -  0 


u2(t)  -  Oj)_1  (t)u1(t) 


u2(0)  -  0 


u  (t)  **  a  (t)u  (t) 
n  in 


u  (0)  *  0 
n 


Vl(t)  *  °0U)un(t) 


Vi(0> 


o  . 


Thus 


un+1(t)  will  be  FDC  if  each  a^t)  is  FDC.  However,  reasoning  from 


the  remark  after  lemma  3.9,  each  a^(t)  will  be  either  deterministic,  or  a 

deterministic  function  multiplied  by  one  of  the  y( »)-dependent  0*  (t)  from 

j  ** 

(3.10).  Now  by  the  proof  of  lemma  3.9  these  0*  (t)  come  from  the 

3  ,k 

y( »)-dependent  terms  in  1  <  i  <  n,  and  Q.  Actually,  inspection 

reveals  that  ^  Q  is  independent  of  y(*),  since  it  is  a  function  of  the 
joint  covariance  C^(t),#,*,€^(*  )|  and  the  only  y-dependence  in  the 

4^  lies  in  Pv.  Recall  from  §2,  that  a  typical  element  of  Pv  is 
cov(€j(s) ,  ?2(t)  -  C^(t));  a  simple  calculation  shows  this  equals 


covt^^s)  ,C2(s)  -  53<s))  -  sinhics  j^e  *Ug(u)du 


(3.11) 


-  k  ^sinhks  f* e  Kug(u)du 
0 


where  g(u)  *  <y(u)  -  V2  *>•  The  y(’)  functionals  in  this  expression  are 

certainly  FDC  and  thus  the  components  0*  .  (t)  are  FDC.  This  completes  the 

3  »k 

proof. 


The  proof  of  proposition  3.7  is  similar  to  the  proof  of  the  linear  case 
due  to  Marcus  and  Wlllsky  (7]  in  its  use  of  Gaussian  moment  identities. 
Actually,  because  conditional  Gaussianity  obtains  in  the  linear  case  without 
first  conditioning  on  x(t),  Marcus  and  Wlllsky  are  able  to  use  the  general 
filtering  equation  and  a  simpler  moment  identity  than  lemma  3.8  to  build  a 
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proof  by  induction  on  the  order  of  h(t).  By  'general  filtering  equation'  is 
meant  the  representation  of  Fujisaki,  Kallianpur,  Kunita  [2] s 


k  a  K.  k 

dn  -  e(x  Vt)  /*•••  /  n"2Y(t,»*)x  2(s,)***x  n(s  )ds  •••ds 

■  i  n- 1  n- 1  i  i 

0  0 


dt 


(3.12) 


A  A 


+  (n(t)x(t)  -  n(t)x(t)] [dy(t)  -  x(t)dt) 


In  our  proof,  application  of  (3.12)  is  superfluous,  although,  when  calculating 
the  filter  in  a  particular  example,  it  can  be  employed  to  advantage.  The 
example  below  will  illustrate  the  possibilities. 

Marcus,  et  al  [6]  give  an  alternate  proof  of  finite  dimensional 
computability  when  f  is  linear  by  using  homogeneous  chaos  theory  and 
multiple  integral  expansions.  Such  an  approach  might  also  be  possible  here  by 
first  conditioning  on  x(t),  but  this  is  not  pursued,  since  the  calculation 
would  ultimately  be  like  the  one  here. 

Example.  Consider  the  model 

dx(t)  -  f(x(t) )dt  +  db(t)  x(0)  -  xQ 

dh(t)  *  x2(t)dt  n(0)  -  0 

dy(t)  -  x(t)dt  +  dw(t)  y(0)  =  0 

where  the  x(*)  and  y(*)  equations  are  as  in  (1-1)— (1.2).  We  will  present 

a  finite  dimensional  system  for  computing  n(t)  *  e(  /tx2(s)ds|f:^}.  This 

0 

problem  was  chosen  in  part  by  way  of  comparison  to  the  special  case  f  =  0 
which  is  treated  in  detail  in  Liu  and  Marcus  [4] .  The  system  given  here  for 

A 

n(t)  is,  of  course,  one  among  many  possibilities*  our  construction  was 
guided  by  the  decision  to  use  Ito  equations  driven  by  the  innovations 

A 

dV(t)  s-  dy(t)  -  x(t)dt. 
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Let 


u(t)  -  (sinhtct)"2  J*  (sinh*s)2d8  -  (sinh<t)-1  t(4K)_1sinh2ift  -  V2  t] . 
0 


Then 


-  ^  ^3  V 

an  =  x  dt  +  u(t)[x  -  x  X]dv 

+  2[?-  x2]  [u(t)(v2(t)<"1sinh»et  +  (oy(t)  -  V)) 

+  v^tjsinhict  -  (<8inh<t)  1v3<t)]dv 


n(0) 


dv1  =  sinhKt  (U  -  0y(t))  ^+({0  dt 
dv2  =  e  Kt[<y(t)  -V2b]dt 


dv3  -  (sinhKt)  v2 ( t ) dt 


v1 (0)  *  0 


v2<0)  *  0 


v3(0)  -  0. 


)  (3.13) 


A  ^  ^3 

(3.13)  is  not  the  complete  system,  since  equations  for  u,0,x,x  ,  and  x  are 
also  needed.  However  these  are  easily  garnered  from  $3.  A  brief  derivation 


of  (3.13)  follows.  From  (3.12) 


A  ^  /\ 
dh  -  x  dt  +  (hx  -  nx)dv. 


(3.14) 


However,  corollary  2.9  implies 


eCx2(s)  |F  ^,x(t)}  -  Q22  -  r'J(t)Q21012  +  E2(x(s)|F £,x(t)> 
*  F(t,s)  +  r”2(t)Q2i  x2(t) 

+  2x(t)r'1’(t)Q21(m1(8)  -  (Pv)2  -  r,]<t>Q21(Vt)  -  Pv^) 
where  F(t,s)  combines  those  terms  not  depending  on  x(t).  Now 


(3.15) 


-18< 


sinh<s/sinh<t, 


(t)Q 


21 


and 


Pv  *  Pv  (s)  -  <  ^sinhKs  (/%  Kug(u)du  -  /8e  KUg(u)du]. 
41  0  0 

(Recall  that  g(u)  =  <y(u)  -  1/2  b.)  Further,  it  can  be  shovm 
m^t)  -  Pv^t)  ■  ( M  -  dy)(t). 

Using  these  identities  in  (3.15)  it  follows  that 


hx  -  nx  ■  /^E C ( x ( t )  -  x(t))E{x2(s) |F^,x(t)} |F*}ds 


/N  /\  » 

,  3  2 

(x  -  x  x 


)u(t)  +  2(x^  -  x2)u(t)((oy  -  n)  +  K  ^sinh<t  /fce  <Ug(u)du 


+  2(x2  -  x2)[(sinhKt)  1  /fc  (sinhKsMm^  (s)  -  Pv^sJlds 


-  (KsinhKt)  1  /^(sinhics)2  /8e  KUg(u)duds] . 
0  0 


(0  -  x2x)u(t)  +  2(x2  -  x2)  [u(t)(v2(t)<“1sinhKt  + -~j(oy(t)-U)) 


+  VjftlsinhK  +  -(KsinhKt)  V^t)] 


(3.16) 


Placing  (3.16)  in  (3.14)  one  obtains  the  desired  result. 


-19- 


REFERENCES 


1.  v.  E.  BeneS,  Exact  finite  dimensional  filters  for  certain  diffusions 
with  nonlinear  drift.  Stochastics  5  (1981),  65-92. 

2.  M.  Fujisaki,  G.  Kallianpur,  and  H.  Kunita,  stochastic  differential 
equations  for  the  non  linear  filtering  problem,  Osaka  J .  Math .  9 
(1972),  19-40. 

3.  A.  H.  Jazewinski,  Stochastic  Processes  and  Filtering  Theory, 

Academic  Press,  New  York,  1970. 

4.  C-H  Liu  and  S.  I.  Marcus,  The  Lie  algebraic  structure  of  a  class  of 
finite  dimensional  nonlinear  filters,  in  Lectures  in  Applied 
Mathematics  18  (1980),  277-297. 

5.  S.  I.  Marcus,  S.  K.  Mitter,  and  0.  Ocone,  Finite  dimensional 
nonlinear  estimation  for  a  class  of  systems  in  continuous  and 
discrete  time,  in  Analysis  and  Optimisation  of  Stochastic  Systems 
(Proc.  Internat.  Conf .  Uhiv.  Oxford,  Oxford,  1978),  387-406,  Academic 
Press,  London,  1980. 

6.  S.  I.  Marcus  and  A.  S.  Willsky,  Algebraic  structure  and  finite 
dimensional  nonlinear  estimation,  SIAM  J.  Math.  Anal.  9  (1978), 
312-327. 

7.  D.  Ocone,  Finite  dimensionally  computable  statistics  and  estimation 
algebras  in  nonlinear  filtering.  Proceedings,  1981  Int.  Syra. 
Mathematical  Theory  of  Networks  and  Systems,  Santa  Monica,  CA, 

Aug.  5-7,  1981. 

8.  R.  W.  Brockett,  to  appear  in  Proceedings,  NATO  ASI  on  Mathematics  of 
Stochastic  Systems,  Les  Arcs,  1981,  Reidel  Press  • 

DLO: JSB:SIM/db 


-20- 


SECURITY  CL  ASSIF  ICATION  OF  THIS  PACE  0>hn  l  I  >«u«  F'nl.r.dl 

REPORT  DOCUMENTATION  PAGE 

I.  REPORT  NUMUJLU.— - -  —  - "  -  b.  GOVT  ACCESSION  NO.  3.  Rt'ClPl CNT'YWfTAtOC  NUMBER 


\.  REPORT  NUMUJLtt— 


2254  ^  frt\  .  ~T:  / 


U*  TITLE  (end  Subtitle^ 


EXPLICIT  JILTERS  FOR  DIFFUSIONS  WITH  RETAIN 
NONLINEAR  DRIFTS  * 


^  '1  liy  JVg£.Q4L  BtBft%J.^-B6RIOD  COVEREO 

'■j  summary  j?ep®rt  -  no  specific 

"  reporting  period _ 

6.  performing  org.  report  number 


7.  AuTHORf.J 

D.  L.^Ocone,  J.  S., Baras  and  S.  I. /Marcus 


SQO14rI2r£-IJg08^.- . 

./DAAGZ9-8O-C-0041;/ 
-MCS-79J27062 _ 


9.  PERFORMING  Of7C  AN  J  2  AT  JON  NAME  ANO  ADORESS  10.  PROGRAM  ELEMENT,  PROJECT,  TASK 

Mathematics  Research  Center,  University  of  AREA  *  V,0R,<  UN,T  NUM0E*S 

610  Walnut  Street  Wisconsin  4-probabiiity  , 

Madison.  Wisconsin  53706 _ 

II.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS  12.  REPORT  DATE 

/'  )  AugOWffl981  . 

See  Item  18  ....  *'  »»•  number  of  pages 


4-Probability  and  Statistics 


U.  MONITORING  AGENCY  name  A  ADDRESS  (II  dltlerent  item  Controlling  Ollieo)  IS.  SECURITY  CLASS,  (ot  ttf  *  report) 

UNCLASSIFIED 

ISA.  DECLASSIFICATION/  DOWNGRADING 

schedule 

i«7  DISTRIBUTION  STATEMENT  (a(  thle  Report) 

Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (ot  tho  ebmtrmct  entered  in  stock  20,  It  dUltrnl  from  Report ) 


18.  SUPPLEMENTARY  NOTE;# 

U.  S.  Army  Research  Office  •  National  S< 

P.  O.  Box  12211  Washington 

Research  Triangle  Park 
North  Carolina  27709 

$9.  KEY  WORDS  (Conlinum  on  rtr#rt«  eide  it  neceeeery  and  Identity  by  block  number) 


■  National  Science  Foundation 
Washington,  D.  C.  20550 


Nonlinear  filtering 


20.  ABSTRACT  (Confirm*  on  rmn«  cldc  It  ntetiury  and  Identify  by  btock  nuttber) 

Let  x( t)  be  a  dif fusion  satisfying  the  stochastic  differential 
equation  dx(t)  -  f(x(t))dt+  db(  t) ,  where  f'(x)  +  f2(x)  -  ax2  +  bx  +  c, 
a  >  0.  V.  BeneS  gave  an  explicit  formula  for  the  conditional  density  of 
x(t)  given  y(  s) ,  0  <  s  a  t,  where  y(  s)  -  /fcx(  s)  ds  +  *  ( t) ,  when  w(  .)  is 


DD  AWn  1473  COITION  or  I  NOV  «S  IS  OBSOLETE 


_ UNCLASSIFIED  e* >' 

SCCURITV  CLASSIFICATION  OF  THIS  P*GE  Ti.n  P.r.  iTl.r.d) 


20.  Abstract  (continued) 


a  Brownian  process  independent  of  x(  •).  This  result  is  extended  and  then 
applied  to  derive  recursive  filtering  equations  for  estimating  conditional 
moments  E (xn(t)  ly(  s) ,  0  <  s  <  t}#  for  estimating  polynomial  functionals  of 
x ( 4  /  and  for  smoothing. 


